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Abstract 

The ultimate goal of research efforts 
directed at underload, boredom, or compla- 
cency in high-technology work environments 
is to detect conditions or states of the 
operator that can be demonstrated to lead 
to performance degradation, and then to 
intervene in the environment to restore 
acceptable system performance. Physio- 
logical measures may provide indices of 
changes in condition or state of the 
operator that may be of value in high- 
technology work environments. The focus 
of the present study was on the use of 
physiological measures in the assessment 
of operator condition or state in a task 
underload scenario. A fault acknowledg- 
ment task characterized by simple repeti- 
tive responses with minimal novelty, 
complexity, and uncertainty was employed 
to place subjects in a task underload 
situation. Physiological measures (ECG, 
EEG, and pupil diameter) were monitored 
during task performance over a one-hour 
test session for 12 subjects. Each of the 
physiological measures exhibited changes 
over the test session indicative of decre- 
ments in subject arousal level. While 
high correlations between physiological 
measures were found across subjects, 
individual differences between subjects 
supports the use of profiling techniques 
to establish baselines unique to each 
subj ect . 


Introduction 

With the development and increasing 
number of high-technology work environ- 
ments, the roles, functions, and tasks 
performed by people in these environments 
need to be considered carefully. Although 
not unique to high technology or automated 
environments, words such as boredom, 
underload, and complacency describe condi- 
tions of the human operator or system 
manager that may have major impact on the 
performance and safety of high-technology 
systems. 

Increased automation can change the 
nature of the task that the operator is 
performing, and may increase the monitor- 


ing or vigilance component of a task 
( Parasuraman, 1987). Many studies and 
reports concerning the effects of aircraft 
automation may be found in the literature 
(e.g. Bergeron & Hinton, 1985; Wiener, 
1985; Wiener & Curry, 1980). Each report 
echoes concern, both about errors made in 
the use of automated systems and failure 
of the operator or crew to detect errors 
when using an automated system. 

Reports concerning the effects of 
automation on commercial aircraft pilots 
note that too much automation may result 
in complacency and boredom (Chambers & 
Nagel, 1985), and pilot reports of just 
"being along for the ride." (Chambers & 
Nagel, 1985; Wiener, 1985). Chambers and 
Nagel (1985) discuss potential alterna- 
tives in the allocation of functions 
between automated systems and the human 
operator. In one system, which they 
called the "pilot’s assistant concept," 
the pilot plays an active role as the 
system manager. It was suggested that the 
active role of the pilot may serve to 
reduce complacency and boredom. A second 
system, the "electronic copilot concept," 
was presented in which the pilot functions 
as a passive monitor, with concomitant 
risks of complacency and boredom. In 
reviewing the report by Chambers and 
Nagel, Parasuraman (1987) suggested "that 
the goal of human factors engineering must 
not necessarily be to reduce workload but 
to optimize it." 

In research on vigilance, conditions 
described as boredom, monotony, and 
fatigue have been reported as having over- 
whelming effects compared to the many 
variables (e.g., temperature, noise, cir- 
cadian effects, illumination, and vibra- 
tion) that have received experimental 
attention (Mackie, 1987). Studies examin- 
ing stress effects on sonar operators show 
that boredom, monotony, and fatigue were 
ranked the highest of all the stressors 
considered (Mackie, Wylie, & Smith, 1985). 

The ultimate goal of research efforts 
directed at underload, boredom, or compla- 
cency is to detect conditions or states of 
the human operator or crew member that can 
be shown to lead to performance degrada- 
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tion, and then to intervene in the automa- 
ted work environment to restore acceptable 
system performance. While monitoring of 
machines by human operators has a long 
history, monitoring of the human operator 
by the machine, or better yet, an interac- 
tion or "dialog" between the human and 
machine is only becoming feasible through 
the technology of today and the promises 
and potential of the technology of 
tomorrow . 

In order to detect changes in the 
condition or state of the human operator 
or crew member, physiological measures may 
provide the indices required. Many 
studies have been conducted exploring the 
relationship between physiological 
parameters and "workload," "vigilance," or 
"fatigue" (See O'Donnell, 1979, for a 
review), and physiologically driven 
"alertness indicators" (O’Donnell, 1979, 
pp. 57 & 62) have been suggested and ex- 
plored. However, in order for these 
measures to be employed as viable indices 
of operator condition or state, research 
efforts must take advantage of new and 
steadily improving sensor technology, and 
state-of-the-art analysis methodologies. 
Horst ( 1988) discusses some of the areas 
of application and problem areas associ- 
ated with physiological measures, and 
notes that on-line or real-time applica- 
tions of physiological indices may in- 
clude: (1) assessment of "the general 

state of the operator," in order to deter- 
mine whether the operator should be "in 
the loop" at all, (2) dynamic task allo- 
cation between human and machine, and 
(3) detection of important events that the 
operator did not attend to or detection of 
events with error responses (Horst, 1988, 
p. 30). 

The focus of the present study was on 
the use of physiological measures in the 
assessment of operator condition or state 
in a task underload scenario. Research 
directed at detecting conditions or states 
of the operator in a task underload scena- 
rio that can be related to performance 
degradation can be conceptualized as 
having four stages: 

(1) Stage 1 involves establishing the 
sensitivity of selected physiological 
measures to the condition or state of the 
operator in task underload scenarios. 
This stage may be accomplished, as in the 
present study, through physiological 
measurement of subjects in laboratory or 
simulation environments. One question to 
be answered at this stage is whether there 
are generic measures that may be used as 
indicators for all human operators or 
whether individual differences between 
people require the development of profiles 
unique to individuals or groups of indi- 
vidual s. 


(2) Stage 2 is concerned with estab- 
lishing the relationship between observed 
physiological changes and task perform- 
ance. Obviously, there may be many attri- 
butes to tasks i n the high technology 
environment, involving a variety of types 
of cognitive processes on the part of the 
operator. For example, if physiological 
measures are indicative of operator "bore- 
dom," on which types of tasks can one look 
for degraded performance (e.g. perceptual, 
memory, problem solving / decision 
making). This stage may be investigated 
most easily by studies conducted in set- 
tings in which a high degree of control 
over the task is possible, such as in 
laboratory or simulation environments. 

(3) Stage 3 involves establishing the 
relationship between physiological indices 
and performance in real-world settings. 
In order to accomplish this, performance 
assessment and physiological measurement 
may be conducted in instrumented aircraft 
or instrumented ground transportation 
vehicles. In order to investigate under- 
load or "boredom" in real-world settings, 
it may be necessary to monitor operators 
or crew members over extended periods of 
time. 

(4) Stage *4 involves the development 
and testing of off-line and on-line inter- 
ventions. Such interventions or remedia- 
tion strategies would be designed to 
insure that conditions or states of the 
operator associated with performance 
degradation are handled in such a way as 
to restore acceptable system performance. 

The present study was directed at 
Stage 1, described above, and was focused 
on establishing the sensitivity and inter- 
relationship of heart rate and heart rate 
variability, pupil diameter, and electro- 
encephalographic data during performance 
of a task in which the subject was under- 
loaded. The characteristics of such a 
task, simple repetitive responses with 
minimal novelty, complexity, and uncer- 
tainty (Cooper, 1 968), were such that 
boredom would be expected. 


Methodology and Design 

Suhj ££_L£. Physiological and task 

performance data were obtained from 12 
subjects (10 male; 2 female). Subject 
ages ranged between 20 and 44 years, with 
a median age of 28.5 years. Subjects were 
volunteers from among the staff and con- 
tract personnel of the NASA Langley Re- 
search Center . 

Xa.5.k. A fault acknowledgment task 
(five alternative choi ce-reactio n- time 
task) was selected as a laboratory bench- 
mark task for inducing boredom. The fault 
acknowledgment task consisted of a desk- 
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top-computer-generated jet engine pictori- 
al in which one of five: areas could be 
highlighted in red. The task for the 
subject was to detect the fault, then to 
press the appropriate response key for the 
hi ghl i gh te d area, which turned off the 
highlighted area. The highlighted area 
remained lighted until the subject re- 
sponded. If the subject did not respond, 
a time-out occurred after about 30 sec- 
onds, and a new fault was presented. The 
task was presented on a CGA computer moni- 
tor and responses were made on the desktop 
computer keyboard. 

Subject response times and accuracy 
of responding were recorded for each fault 
presentation. Frequency of presentation 
of faults, or i nter tri al-i nterv al (ITI), 
for half the subjects was 6 seconds (ran- 
domly ranging between 4.8 and 7.2 seconds) 
throughout the test session and for the 
remainder of the subjects alternated be- 
tween 20 second ITIs (range: 16 to 24 

seconds) and 2 second ITIs (range: 1.6 to 

2.4 seconds) with each ITI maintained for 
blocks of 5 minute duration. The alterna- 
ting ITI condition was incorporated in the 
study in order to examine contrasts in the 
physiological data during periods in which 
the task made differing demands on the 
subject. A complete test session lasted 
approximately one hour and consisted of 12 
five minute blocks. A time synchroniza- 
tion signal was sent from the desktop 
computer to a Digital Equipment Corpora- 
tion (DEC) Modular INstrument Computer 
(MINC) system on which the physiological 
data were recorded. 

P rocedure . Upon arrival at the la- 
boratory, subjects initially completed 
voluntary consent forms, then electrode 
attachment began. After electrode instal- 
lation, subjects were seated in front of 
the task display where instructions on 
performing the task were given and cali- 
bration of the non-contact oculometer 
system used to measure pupil diameter was 
completed. The experimental session was 
then started. Time keeping devices (e.g. 
clocks and wrist watches) were removed 
from the experimental setting during the 
test session to minimize the subject’s 
awareness of the time remaining in the 
test session. At the conclusion of the 
test session information was obtained from 
each subject concerning food, beverages, 
medications, and sleep prior to the test 
session. Subjects were also queried about 
task strategies or mental ’’games” that 
they engaged in during the session. 

Subj££-t self-report measu re s . Each 
subject completed the Jenkins Activity 
Survey (JAS) (The Psychological Corpora- 
tion) and the Eysenck Personality Inven- 
tory (EPI) (Educational and Industrial 
Testing Service). The JAS provided an 
index of the Type A behavior pattern. 


P r i c r t u d i e s h a v c e x p 1 or e c the r el a t i o n- 
ship between the' Type A behavior pattern 
and physiological responses, and, in par- 
t i c u 1 a r , heart rate* and blood pressure 
(Perkins, 1984; Lake, Suarez, Schnei der- 
ma n, & Tocci, 198b). The EPI provided an 
index of i r.tr ov ersi on-ext r aver si on. 


Physiological measures 

Heart _R a_te I Ml H e a r t laJLe _Vaxi- 

Sbilitx 1HRV1. The electrocardiogram 
(ECG) signal, f rom which HR and HRV were 
derived, was obtained through active elec- 
trodes attached to the top of the sternum 
and to the lower left rib cage. A refer- 
ence electrode was attached to the left 
ankle. The ECG signal was fed through an 
op to- isolated bioamplifier to a schmitt 
trigger which produced a digital output 
upon an ECG signal positive-going thres- 
hold crossing (R-wave). The time interval 
between successive threshold crossings, or 
inter-beat interval (IBI), was recorded on 
the DEC MINC system. 

Pupi l D iame ter ( PD) . The PD of each 
subject was measured using a non-contact 
i nf rar ed-1 igh t bright-pupil oculometer 
system. The oculometer electro-optical 
head was located 60-80 cm from the subject 
and to the left of the CGA color monitor 
presenting the task. PD was sampled at 
one-second intervals throughout the test 
session and recorded on the DEC MINC 
system. 

LE££1 • EEC 

recording sites were over the occipital- 
parietal cortex (locations 01 and P 3 ) 
using a bipolar lead configuration, with 
the reference electrode at the ipsalateral 
mastoid bone. The power (integrated am- 
plitude) of the EEC signal in the various 
frequency ranges was obtained by filtering 
the signal and integrating the filtered 
output. The EEG signal was filtered into 
five frequency range components: (1) delta 
(1-4 Hz), (2) theta (4-8 Hz), (3) alpha 
(8-13 Hz), (4) beta 4 ! (13-20 Hz), and (5) 
beta2 (20-40 Hz). The output of each 
filter was fed to a contour following 
integrator with a 1 second time constant 
(Coulbourn Instruments filters and inte- 
grators). The integrated amplitude of 
each of the five EEG frequency ranges was 
sampled by the DEC MINC system at one- 
second intervals throughout the test ses- 
sion. 


Results and Discussion 

Task Performance . The primary pur- 
pose of the task in the present study was 
to place the subject in a situation of 
task underload, a situation in which bore- 
dom would be expected. As would be an- 
ticipated on a task of this type, few 
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1. i n; e s w e r e under o n e 


second. Two s w b j t c t s s h ow e d decree s e d 
response t i m e s Uirou^hout t h e t, e s t ses- 
sion, and three c t h e r s maintained rela- 
tively steady re s po n se times. Th e r em air- 
ing seven subjects displayed either slow 
increases in response time or increased 
response times during several 5 minute 
blocks during the test session (typically 
near the end of the session). At no time 
did a subject completely fail to respond 
to the task, although response times ex- 
ceeding 10 seconds were obtained front twc 
subjects during periods when they appeared 
to be near sleep. 
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Heart Rate and Heart R ate Variab ility . 
As would be expected from subjects per- 
forming a task with low demands, HR (com- 
pared for each 5 minute block) showed a 
slight decrease after the initial block, 
and then remained steady during the rest 
of the test session. Despite the relative 
constancy of average HR, on a within-sub- 
jects basis, HRV was found to correlate 
positively with block number for each of 
the 12 subjects, indicating an increase in 
HRV with time on the task. Indices of HRV 
used in the present study were based on 
filtering and computing the power spectral 
density for the IBI data. Two measures of 
variability were examined: (1) total 

power, and (2) power in the .05 to .15 Hz 
bandwidth. This band has typically been 
associated with blood pressure regulation 
(Kitney, 1980). Figure 1 shows the plot 
of power (means for 11 subjects) in the 
the task. The figure shows an increase in 
average HRV with time on the task. 


Figure 2. Averaged pupil diameter for 11 
subj ect s. 

EEC . As noted above, the EEG signal 
was filtered into five frequency range 
components: (1) delta (1-4 Hz), (2) theta 

(4-8 Hz ) , (3) alpha (8-13 Hz), (4) betal 

(13-20 Hz), and (5) beta2 (20-40 Hz). EEG 
data consisted of the level of the inte- 
grated amplitude of each of the frequency 
components (sampled at 1 Hz). An initial 
hypothesis under test was that continued 
performance of an underload task would 
lead to shifts in the EEG activity from 
faster activity (beta) to slower activity 
(delta and theta). The data did not sup- 
port this hypothesis. Analogous to the 
relationship between HR and HRV, average 
levels of activity within each frequency 
band generally remained steady, while 
variability of the levels within each 
frequency band exhibited changes with time 
on the task. Although variability of each 
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Figure 1. Averaged spectral power (.05 - Figure 3. Averaged alpha variance for 11 
.15 Hz) of IBI for 11 subjects. subjects. 


Pupil Diameter . In general, PD has 
been found to decrease when variety and 
novelty in the field of view is minimized. 
Figure 2 presents the relationship between 
mean pupil diameter for 11 subjects over 
the course of the test session. As shown 
in the figure, mean pupil diameter de- 
creased with time on the task. 


of the lower frequency EEG bands (delta, 
theta, and alpha) exhibited increases with 
time on the task, the measure having the 
highest correlation with HRV and PD was 
alpha variability. Figure 3 presents 
alpha variance (means of 11 subjects) 
versus block number on the task, and shows 
an increase in alpha variance with time on 
the task. 
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1 n t err el a_ti Qssh ±£> Of jnii a^jjrjrs . General Discussion 

Simultaneous recording of ECO, PD, and EEG 

permitted examination of the interrela- In an underload scenario each of the 

tionship between these measures. Figure 4 physiological measures used in the present 

shows an index of DRV plotted against PD. study are prone to a "ceiling" (or 

In this figure the spectral power of the "floor") effect as there are Jimits to 

IBI data in the .05 to .15 Hz band (means increases in H RV , alpha variability, or 

of 11 subjects) for each block is plotted decreases in PD. Therefore, it would be 

versus mean pupil diameter for each block. expected that over sufficient time 

The figure shows increased H RV concomitant periods, these parameters would reach 

with decreased PD. Figure 5 presents the asymptotic levels. As illustrated by 

relationship between the H RV index and figures 1, 2, and 3, which show averages 

alpha variance (means of 11 subjects) for over the test session for HRV, PD, and 

each block, and illustrates increases in alpha variance, asymptotic levels were not 

alpha variance accompanying increases in reached in the one hour test session using 

the HRV index. While the data presented the fault acknowledgment task. This sug- 

in figures 4 and 5 show high correlation gests that future studies may benefit from 

coefficients between measures, when means a longer period of testing, or perhaps an 

for the 11 subjects are used, it should be on-line assessment of physiological indi- 

noted that large individual differences in ces to determine the duration of an exper- 

each of the physiological measures are imental session for a given subject, 

noted when examining the data at the 

single subject level. Therefore, figures Unlike changing the speed of opera- 

4 and 5 should not be interpreted simply tion or load on a mechanical device, 

as suggesting a high degree of convergent placing a human operator in an underload 

validity between measures. Illustrating situation does not guarantee performance 

the independence of the measures, it was deficits or that the operator will be 

found that some subjects displayed changes bored. Many of the subjects in the 

in one physiological index while showing present study reported engaging in a vari- 

little or no change in another. These e ty cf mental tasks or "games" in order to 

results support the use of profiling tech- maintain alertness. In effect, the sub- 

niques in order to establish baselines jeets were making changes in load or 

unique to each individual. "busyness" beyond the demands placed on 

them by the task. Despite engaging in 
these activities, the majority of subjects 
exhibited physiological changes during the 
test session indicative of decreases in 
arousal level. 

The next step in exploring the physi- 
ological assessment of task underload is 
to establish the relationship between 
observed physiological changes and attri- 
butes of task performance. In order to 
accomplish this step, it is necessary to 
^ Pupil dia. (mm) ° measure physiological indices while sub- 

jects perform (for extended time periods) 
Figure 4. IBI spectral power (.05 - .15 tasks i ncorpor a ti ng and sensitive to the 

Hz) versus pupil diameter (Mean for 11 types of activities that operators may 

subjects). encounter in operational settings. 




Alpha variance ( \i volts) 


Figure 5. IBI spectral power (.05 - .15 
Hz) versus alpha variance (Mean for 11 
subj ect s) . 
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